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1 Introduction. 



Consider a linear programming problem in the following primal/dual form: 

min (c, x) and max (b, y) . 

Ax — s = b A T y = c 

s > y > 

Here m > n > 1 and A is an m x n real matrix assumed to have rank n, 
b G M m and ceR™ are given vectors and c is non-zero, y,s G M m and a; G M n 
are unknown vectors (s is the vector of slack variables). 

Our principal result bounds the total curvature of the union of all the 
central paths associated with all the feasible regions obtained by considering 
all the 2 m possible sign conditions 

Si 0, i = 1, ■ ■ ■ ,to, 

where 6j is either > or < . 

Formal definitions will be given in subsequent sections. The rest of the 
results in the introduction follow from the next theorem which requires the 
rest of the paper. 

Theorem 1.1. Let m > n > 1. Let A be an m x n matrix of rank n, and 
let b G W 71 and c G M n , c non-zero. The sum over all 2 m sign conditions 
of the total curvature of the primal/dual central paths (resp. primal central 

(m — 1 \ 
j (resp. 2n(n — 

n J \ n J 

Theorem 11.11 allows us to conclude various results on the average curvature 
of the central paths corresponding to various probability measures on the 
space of problems. We begin with our main motivating example. 

Central paths are numerically followed to the optimal solution of linear 
programming problems by interior point methods. For relevant background 
material on interior point methods see Renegar [21]. Our point in studying 
the total curvature is that curves with small total curvature may be easy to 
approximate with straight lines. So, small total curvature may contribute 
to the understanding of why long step interior point methods are seen to 
be efficient in practice. In Dedieu-Shub we studied the central paths of 
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linear programming problems defined on strictly feasible compact polyhedra 
(polytopes) 1 from a dynamical systems perspective. In this paper we opti- 
mistically conjectured that the worst case total curvature of a central path 
is 0(ri). Our first average result and main theorem lends some credence to 
this conjecture, proving it on the average. 

If we assume that the primal polyhedron {x|v4x — 6 = s>0}is compact 
and strictly feasible (i.e., has non-empty interior), then the primal and dual 
problems have central paths which are each the projection of a primal/dual 
central path and all these central paths lead to optimal solutions. So for our 
purposes we will get a meaningful number if we divide the total curvature 
of the central paths of the all the strictly feasible polytopes arising from all 
possible sign conditions by the number of distinct strictly feasible polytopes 
associated with the 2 m sign conditions: 

Ax — s = b Si €i i — 1, . . . , m, 

where 6j is either > or <. The cardinality of the set of these polytopes is 

(Tfi 1 \ 

^ j and equality holds for almost all (A, 6), see section When 

equality holds we say (A, b) is in general position.. 

We use Theorem ll.ll to give an upper bound on the sum of the curvatures. 
We obtain the following average result. 

Main Theorem. Letm > n > 1. Let A be anmxn matrix of rank n, and let 
b G M. m and c G M™, c non-zero such that (A,b) is in general position. Then 
the average total curvature of the primal/ dual central paths (resp. primal 
central paths, dual central paths) of the strictly feasible polytopes defined by 
(A,b) is less than or equal to 27m (resp. 27r(n — 1), 2ixn.) 

We may also average over more general probability measures on the data 
A, b, c defining the problem. First we more precisely define the space of prob- 
lems P and measures /i, v we consider. P = Ix M m x R n . Here lis the open set 
of rank(n), m by n real matrices, and we assume for convenience that no row 
of any element of / is identically zero. Let D be the group with 2 m elements 
consisting of those m by m diagonal matrices whose diagonal entries are all 
either 1 or -1. So for D G D, D acts on P by D((A,b,c)) = (DA,Db,c). 
The set of problems defined by the orbit of (A, b, c) under the action of D 

1 A feasible region for a linear programming problem is a polyhedron, a compact poly- 
hedron is a polytope. 
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is the same as considering (A, b, c) with all possible sign conditions, so each 
orbit has 2 m distinct elements. We say that a probability measure /i is sign 
invariant if it is invariant under the action of D, i.e. -D*/i = \i for all D e D. 

We now generalize Theorem ^ once again averaging over problems with 
a strictly feasible primal polytope. 

Let n be a sign-invariant probability measure on the data A, b, c. If 
the the set of (A, b, c) in P such that (A, b) are in general position has full 
measure we will say that is full (for general position). This is the 
case for example if /i is supported on a finite union of orbits of D through 
elements in general position or if [i is absolutely continuous with respect to 
the Lebesgue measure, see section |B] For instance, an independent Gaussian 
probability distribution with zero average and arbitrary variance for each 
coefficient of the data is sign invariant and full. 

Corollary 1.2. Let m > n and let /i be a sign-invariant and full (for general 
position) probability measure on P. Let Feas be the set of data A, b, c with a 
strictly feasible primal polytope. Let v be the conditional probability measure 
(with respect to Feasj defined for any measurable V by 

= n(V n Feas) 
/i(Feas) 

Then, the average (w.r.t. v) total curvature of the primal/ dual central path 
(resp. primal central path, dual central path) is less than or equal to 27m 
(resp. 27r(n — 1), 27m.) 

This corollary while almost immediate requires a little proof which we 
carry out in section |3 There is another version of Corollary 11.21 which is 
perhaps a little more natural form the point of view of regions which have 
central paths defined for all positive parameter values. We state it below 
but don't prove it as the proof is the same as for Corollary 11.21 For a 
primal/dual central path to exist for all positive parameter values a necessary 
and sufficient condition is that both primal and dual problems are strictly 
feasible see j2H],IS21 • If this is the case we say that the primal/dual polyhedra 
are jointly strictly feasible. Every strictly feasible primal polytope gives 
rise to primal/dual jointly strictly feasible polyhedra, but there are more 
of the later generally among the polyhedra arising from the 2 m possible sign 
conditions in a linear programming problem. Generally the number of jointly 

strictly feasible primal/dual polyhedra is I I . We may see this simply since 
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there are generally I J vertices to the primal polyhedra and at each vertex 
almost all non-zero c select a unique primal polyhedron for which that vertex 

(Tfl \ 
j we 

say that (A, b, c) is in joint general position. If we consider a sign invariant 
probability measure which is full (for joint general position) i.e. the set of 
problems (A, b, c) which are in joint general position has full measure, we get 
a slight improvement of Corollary 11.21 

Corollary 1.3. Let m > n and let fi be a sign-invariant and full (for joint 
general position) probability measure on P. Let Feas be the set of data A, b, c 
with joint strictly feasible primal/dual polyhedra. Let v be the conditional 
probability measure (with respect to Feasj defined for any measurable V by 

/jl(V fi Feas) 
/i(Feas) 

Then, the average (w.r.t. v) total curvature of the primal/ dual central path 
(resp. primal central path, dual central path) is less than or equal to 27m 2=2 
(resp. 2n(n - 1)«, 2nn^.) 



2 Description of the central path. 

When the optimal condition is attained, the primal and dual problems have 
the same value and the optimality conditions may be written as 




where sy denotes the componentwise product of these two vectors. The 
primal/dual central path of this problem is the curve (x(fj), s(//), y (//)), < 
// < oo, given by 

Ax — s = b 

ATy = C (2.1) 
sy = 

y > 0, s > 
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where e denotes the vector in R m of all l's. 

The primal central path is the curve (x(/x), s (//)), < \i < oo, defined as 
the curve of minimizers of the function — [l ln(sj) + c T x restricted to the 
primal polyhedron. By the use of Lagrange multipliers one sees that this is 
the curve defined by the existence of a vector y(fi) satisfying the equations 
(12. lj) . Thus the primal central path is the projection of the primal/dual 
central path into the (x, s) subspace. 

Similarly, the dual central path is the curve y(fi), < \i < oo, defined as 
the curve of maximizers of the function fi ^ n (Vi) + b T y restricted to the 
dual polyhedron. By use of Lagrange multipliers one sees that this curve is 
defined by the existence of vectors x(/i),s(/i) satisfying ()2.1|) . So the dual 
central path is the projection of the primal/dual central path on the y sub- 
space. 

Note, as we have alluded to in the introduction, that when the primal 
polyhedron is compact and strictly feasible the primal central path is defined 
for all < jj, < oo and then so are the primal/dual and dual central paths. 

3 Curvature. 

Let c : [a, b] — > W 1 be a C 2 map with non-zero derivative: c(£) for any 
t G [a, b]. We denote by / the arc length: 

/(f) = /W)ll dr. 

To the curve c is associated another curve on the unit sphere, called the 
Gauss curve, defined by 

which may also be parameterized by the arc length I of c: 

/ G [0,L] ->c(0 G S n ~ l 
with L the length of the curve c. The curvature is 
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see Spivak [2E1 chapter 1]. In terms of the original parameter we have 



K(t) = _j_ i ( m \ = m ]|c(t)n 2 -c(t) (c(t),m 

"-' '"" dt V \\t(t)\\ / llcf^H 4 * °'~ 



The total curvature K is the integral of the norm of the curvature vector: 



K = I \\k(1)\\ dl . 



Thus, K is equal to the length of the Gauss curve on the unit sphere S" 1-1 C 
W 1 . To compute K we use integral geometry, the next section is devoted to 
that. 



4 An integral geometry formula. 

Let j(t), a < t < b, be a C 1 parametric curve contained into the unit sphere 
S 1 ™ -1 with at most a countable number of singularities (i.e. ^(t) = 0). The 
parameter interval is not necessarily finite: — oo<a<6<oo. Let us 
denote by G n . n -\ the Grassmannian manifold of hyperplanes through the 
origin contained in W 1 . We also denote by dG(TC) the unique probability 
measure on Cr njn _i invariant under the action of the orthogonal group. 

Theorem 4.1. The length of 7 is equal to 

dt = n f #0ftn 7 ) dG{H) 

where j^i^H. ("17) denotes the number of parameters a < t < b such that 
7 (i) G 7i: #(7Yfl7) is the number of intersections counted with multiplicity. 

Proof. If 7 is an embedding then Theorem 14.11 follows from Santalo [221 
chapter 18, section 6], or also see Shub and Smale [23 section 4], where a 
similar theorem is proved for projective spaces or Edelman and Kostlan [TT] . 
Now the set of t such that 4ff{f) 7^ may be written as a countable union 
of intervals on each of which 7 is an embedding. □ 

Definition 4.2. The parametric curve 7 is transversal to 7i G G n ,n-i ( we 
also say 7i is transversal to 7) when j(t) ^Ti at the intersection points. 



d_ 

di 



7(*) 
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Corollary 4.3. If the number of intersections counted with multiplicity sat- 
isfies #(TL fl 7) < B for all transversal TL G G„ >n _i then 



d , . 



dt < ixB. 



Proof. By a usual application of Sard's Theorem, see Golubitsky-Guillemin 
[T2j . non-transversality is a zero measure event. Thus, the integral giving 
L{j) only needs to be evaluated on the set T of TL G G n ,n-i such that TL is 
transversal to 7. Since dG(TL) is a probability measure we get 

L( 7 ) = 7T / #(W n 7) dG(TL) <nB [ dG(TL) = nB. 
Jner JneT 

□ 

In order to bound the number of transversal intersections of the Gauss 
curve with a hyperplane TL, we will need the following fact: let 



Rxl 



be of class C 2 , and assume that we are in the conditions of the Implicit 
Function Theorem, namely _F Mo (co) = and DFh (cq) (the derivative of F 
with respect to the z variables) has full rank. Let c{p) : [/xo — e, A*o + e ] — ► IR r 
be the associated implicit function, c(/x ) = c and F M (c(/i)) = 0, and let 
c(/i) denote the derivative of c with respect to fi. 
Let TL denote a hyperplane, with normal vector h: 

TL = {zeW : (h,z) = 0}. 

Lemma 4.4. In £/ie conditions above, if the Gauss curve 7(/i) = c(/i)/||c(/i) || 
intersects TL transver sally for /1 = /io, iTien (c(/xo), c(/Jo), A*o) a zero of the 
function 



$(c,c,/i) 



^(c) c + F^c) 

(/l,C> 

Moreover, has full rank at that point. 



(4.3) 
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Proof. Equation (|4.3H ) and (jHBJ-2) are the Implicit Function Theorem, and 
equation ()4.3l -3) is the intersection hypothesis. We write Z)$(c, c, //) as the 
block matrix: 



DF,{c) 







D 2 F^c) ®c + DF^c) DF^c) DF^c) c + F„(c) 
h T 



(4.4) 



where D 2 F^{c) <g> c is the linear map y i— > D 2 F^(c)(c,y). By hypothesis, 
DF^{c) is invertible. Hence, the block LU factorization of the matrix in 
(03) is: 

"^(c) 



I 

hFDF^c)- 1 1 



C/23 
^33 



where using ()4.3|) : 

£21 = (i) 2 F,(c) ® c) DF^c)- 1 + DF^cjDF^c)- 1 
U 23 = 2DF^(c) c + F M (c) + F 2 i^(c)(c, c) 



17: 



33 



^ ^Di^CcJ-^F^Cc) c + J D^ t (c)- i F /t (c) + DF M (c)- i J D 2 F M (c)(c,c) . 



Note that by construction, F^(c({i)) = 0. Differentiating once with respect 
to we obtain ([4.31 2). Differentiating once again, 

DF^)) c + D 2 F„(c(fx)) (c, c) + 2DF fl (c( f i)) c + ^(c^)) = 

Solving for c and replacing into C/33, we obtain: 

C/33 = /i T c . 

We need to show that C/ 33 7^ 0. Our hypothesis was that j(t) TC. Multi- 
plying equation (|3.2j) by /i T to the left, we obtain: 



h T i{t) 



h T c(t) 



Hence, C/33 does not vanish and is non-singular at (c ,c ,/io)- 



□ 
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5 A Bezout bound for mult i- homogeneous sys- 
tems. 



According to Theorem 14.11 to estimate the length of a curve we have to 
count the number of points in a certain set. To give such an estimate we 
use the multi-homogeneous Bezout Theorem. While this theorem is well- 
known to algebraic geometers, topologists and homotopy method theorists, 
the computation of the Bezout number is usually only carried out in the 
bi-homogeneous case in textbooks. Morgan and Sommese jTH] prove the 
theorem and give a simple description of how to compute the number, which 
we repeat here. 

Let / = (fi)i<i< n be a system of n complex polynomial equations in n + m 
complex variables. These variables are partitioned into m groups Xi, . . . , X m 
with kj + 1 variables into the j—th group, fa is said mult i- homogeneous if 
for any index j there exists a degree d^ such that, for any scalar A G C, 

fi(Xi, . . . , XX j, . . . , X m ) = A dlJ /j(Xi, . . . , Xj, . . . , X m ). 

In this case the system / is called multi-homogeneous. The Bezout number 
B associated with this system and this structure is defined as the coefficient 

of IlJLi tf J in the P roduct 1T=i Ejli dijCj- 

We say that (X u . . . , X m ) E C n+rn is a zero for / when f(X x , . . . , X m ) = 
0. In that case, f(\\Xi, . . . , \ m X m ) = for any m— tuple of complex scalars 
(Ai, . . . , A m ). For this reason it is convenient to associate a zero to a point 
in the product of projective spaces P fcl (C) x . . . x P fcm (C). We use the same 
notation for a point in P fcl (C) x ... x P fcm (C) and for any representative 
(*!,..., X m ) eC n+m . 

We say that a zero (X 1} . . . , X m ) e P fcl (C) x . . . x P fc ™ (C) is non-singular 
when the derivative 

Df{X 1 ,...,X m ) :C n+m ^C n 

is surjective. Notice that this definition is independent of the representative 
(Xi,...,X m )e C n+m . We have 

Theorem 5.1. (Multi-homogeneous Bezout Theorem) Let f be a multi-ho- 
mogeneous system. Then the number of isolated zeros of f in F kl (C) x . . . x 
P fcm (C) is less than or equal to B. If all the zeros are non-singular then f 
has exactly B zeros. 
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6 The total curvature of the central path on 
the average. 

To the matrix A and the vector b we associate the set of admissible points 
of the primal problem via the set of equalities-inequalities 

Ax — s = b, s > 0. 

We may also consider the other polyhedra contained in the subspace Ax — s = 
b and defined by the inequalities 

Si €i 0, 1 < i < m, 

where e = (ei, . . . , e n ) is one of the 2 m vectors of sign conditions. 

Let J- (A, b) denote the set of such primal strictly feasible polyhedra con- 
tained in the subspace Ax — s = b and Q(A, b) the set of those which are 
compact. 

Lemma 6.1. For A and b almost everywhere, 

#Q{A,b) = R K {m,n) = 

Proof. This statement was proved by Buck [S] for A and b in general position. 
In particular, A and b are in general position except in a set of measure zero, 
Lemma f6. II holds for A and b almost everywhere. □ 

Proposition 6.2. A probability measure on P which is absolutely continuous 
with respect to Lebesgue measure is full. 

Proof. The set of (A, b, c) in P where (A, b) is not in general position has zero 
Lebesgue measure by the above lemma and Fubini's theorem, thus it has zero 
measure for any measure absolutely continuous with respect to Lebesgue. □ 

Now we prove the corollary of the introduction assuming the Main The- 
orem. 

Proof. The group D acts freely on P, let £ denote the orbit space. Then we 
may decompose the measure \x on the orbits of D. Since \x is sign invariant 
each point in the orbit gets equal measure and the same is true for the 
conditional measure u, ie each strictly feasible polytope in the orbit of D 
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gets equal measure when the measure v is decomposed on orbits. Now we 
average over the orbits of points in general position, apply the Main Theorem 
and then average over — . □ 

It remains to prove Theorem ll.il 

The proof of this theorem requires Lemmas 16.31 16.41 and Proposition 16.51 
below. 

Lemma 6.3. For each JF G J-"(A,b), with non-empty primal central paths 
the Gauss curves associated with the central paths cpd(J), cp(jF)and cd(J) 
are well-defined. 

Proof. The primal/dual (resp. primal, resp. dual) central path associated 
with a polyhedron T G F{A, b) satisfies the system of polynomial equations 



Ax — s — b 
A T y - c 
sy - fie 



(6.5) 



with fi > 0, and this system is the same for all those polyhedra. 

Let D s denote the diagonal matrix with diagonal entries S{. Since sy 
( equation 16.51 -3) . D s is invertible. The derivative of is equal to 



fie 



DF^(x,s,y) 



and it factors as: 



7 





0" 










/ 







/ 












A T D7 1 



A -1 

D„ 









A T 



A 

fiD^A 
—fiA T D~ 2 A 





"0 


/ 


0" 










/ 




/ 









Therefore, since A has full column rank, /i > and Sj ^ 0, this derivative is 
nonsingular and we are in the conditions of the Implicit Function Theorem. 
The speed vector 

c = (i, s, y) = -DF^xfjj), y(/i), ^(//)) -1 F M ((a;(//), y(jj,), z(p)) 

is the unique solution of the implicit equations: 



Ax - s = 
A T y = 
sy + sy = e 



(6.6) 



12 



The Gauss curve for the primal-dual problem is (x, s,y)/\\(x, s,y)\\. No- 
tice that because of (jfi.61 -3). s, and y cannot be together equal to so that 
this curve is well-defined. 

The Gauss curve associated to the primal (resp. dual) central path is 
(x, s)/\\(x, s)\\ (resp. y/||y||). Those curves are well defined, for suppose that 
s = 0. Then equations 1)6.51 -3) and ([6.61 -3) combined give: 

sy = fisy. 

Hence, dividing componentwise by s and then multiplying by A T , one ob- 
tains: 

c = A T y = fiA T y = 

which contradict the hypothesis 0. Suppose now yO. Then, by the same 
reasoning one obtains s = fis. Hence, by (16. 6H ). s is in the image of A. Then 
by (|6.5H ). b is in the image of A, and hence the polyhedron Ax — s = b, s > 
is either one point or unbounded. Thus, we showed that the Gauss curves 
for the primal-dual, primal and dual central paths are well-defined. □ 

A point of the curve 7pd is the image under the map 

[x,s,y,x,s,y) i-> 

of a point (x, s, y, x, s, y) satisfying the systems ()6.5j) and ()6.6j) for some /x > 0. 
Similarly, a point of the curve 7p (resp. 7d) is the image of such a point 
under the map 

(x,s,y,x, s,y) h 



(resp. (x,s,y,x,s,y) 



[X,8)\\ 

y 



\y\ 



Lemma 6.4. It is assumed as above that T G J 7 (A, b) and that c* and 7* 
are defined as above. Let u G 1R™, v G lR m , w G M m be not all zero. 

1. Each transversal intersection of the Gauss curve 7pd with the hyper- 
plane 

7~Lpd = { (x, s, y) : u T x + v T s + w T y = } 
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is the image of a nonsingular solution of the polynomial system 



$ A ' b ' c ' u > v ' w (x,s,y,x,s,y,ii) 



Ax — s — b 
A T y - c 
sy — /ze 
Ax — s 
A T y 

sy + sy — e 

u T x + v T s + w T y 



(6.7) 



such that /i > 0. 

2. Let w — 0. Each transversal intersection of the Gauss curve 7p with 
the hyperplane 

Hp = {(A, s) : u T x + v T s = 0} 
is the image of a nonsingular solution of the polynomial system \6. 



3. Let u = and v = 0. Each transversal intersection of the Gauss curve 
7d with the hyperplane 

H D = {y : w T y = 0} 
is the image of a nonsingular solution of the polynomial system fl6'. 7| ). 
Proof. Part 1 is Lemma l4.4[ where and DF^ are computed in (|6.5|) and 

dnsD. 

Part 2 follows from the fact that any transversal intersection of 7p with 
the hyperplane u T x + v T s = corresponds to a transversal intersection of 



wc set 



7pd with the hyperplane u x + v s + y = 0. Indeed, if j-p(fi) 

lpn(ti<) = ijUfjf- Tnen ( m ^) T 7p(/") = if and only if (u,v, 0) T 7p D (» = 0. 

Now, assume that the intersection of 7p with u T x+v T s = is transversal. 
Then, 



d 

— (u,v, 0) T 7p D ( / u) 



1 [u T x + v T s + T y) + (u T x + v T s + T y) ° 1 



\\x,s,y 

- — - — - (u T x + v T s + T y) 
\\x,s,y\\ 



dfi \\x, s,y\ 



\X, S\\ d , -y 1 



\x, s, y\\ dji 



u,v) 7 P (/i) ^ 



14 



and therefore the intersection of 7pd with u T x + v T s + T y = is also 
transversal. 

The proof of Part 3 is similar. □ 

Proposition 6.5. Let m > n > 1. Let A be an m x n matrix of rank n, and 
let b £ R m and c 6 M. n , c non-zero. Then, for any transversal hyperplane 
7i*, the polynomial system \6.1\) has at most 

B PD < 2n (™; 

nonsingular solutions (x, s, y, x, s, y, /i) G M n x R m x M m x ]R n x M m xl"xM 
wzt/i [i > 0. 

// furthermore we have w = 0, the number of nonsingular solutions is 
bounded above by 

3p<2(n-l) 

J/ instead we have u = and v = 0, i/ie number of nonsingular solutions 
is still bounded above by 

B D < 2n (V) 

The proof of Proposition 16.51 is long, and is postponed to Section [7| 

Proof of Theorem \ 1 . 11 The total curvature is the sum of the lengths of the 
Gauss curves corresponding to strictly feasible regions . According to Corol- 
lary a bound £>* for the number of intersections (counted with multiplic- 
ity) of the associated Gauss curves with a transversal hyperplane gives the 
bound 7ri3* for the length. Finally, by lemma IB~^I and proposition 16 . 51 B*. may 
be taken as is proposition 16.51 □ 



7 Proof of Proposition 16.5 



The proof of Proposition 16.51 is quite long, and occupies all of this section. 
There are actually three cases, that are quite similar and will be treated in 
parallel. The symbol * stands for PD, P or D. Each of these cases will be 
known as the primal-dual, the primal and the dual case, respectively. 
We proceed as follows: 
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7.1 Complexification of the equations 

The first step is to complexify the equations, i.e. to keep the coefficients fixed 
and to consider the variables as complex instead of real. 

Lemma 7.1. The number of nonsingular solutions of \6. 7\ ) in j| 4m + 2m + 1 with 
(i > is bounded above by the number of nonsingular solutions of J6'.7| ) in 

C 4m+2m+l mfh ^ q 

Proof. A real root is, in particular, a complex root. It is non-degenerate if 
and only if the determinant of the Jacobian matrix of the derivative does not 
vanish. The non-vanishing of this determinant does not depend on whether 
the matrix is considered as real or complex. □ 

Note that when we complexify the equations, the terms u T x + v T s + w T y 
stand for the usual transpose. 

A standard application of Bezout's Theorem implies that: 

Lemma 7.2. The number of nonsingular solutions of \6. 7| ) in in c 4m+2m+1 
with /i is bounded above by 2 2m . 

This estimate, while ensuring finiteness, is not sharp enough for our the- 
orem. 

7.2 Continuation of non-degenerate roots 

More formally, we denote by ^4pd the set of all complex A,b,c,u,v,w where 
A has rank n, c^O and u, v, w are not simultaneously zero. We also denote 
by Ap (resp. Ad) the intersection of -4pD with the linear space w = (resp. 
u = and v = 0). 

Then, £>* will denote the maximal number of non-degenerate complex 
roots of ()6.7|) with fi ^ 0, where * is one of PD, P, D and the maximum 
is taken over all parameters in A„. As in Remark 17.21 £>* is finite. Hence 
this maximal number is attained, and at that point all the non-degenerate 
complex roots may be continued in a certain neighborhood. Thus, 

Lemma 7.3. The maximal number B* of non- degenerate complex roots is 
attained in a certain open set of A*. 

Proof. Lemma l7T2l implies that £>* is attained for some parameter (A, b, c,u,v,w). 
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By the Implicit Function Theorem, the non-degenerate complex roots of 
(|6.7|) with /i ^ can be continued to non-degenerate complex roots with 
fi 7^ 0, in a certain neighborhood of the parameter (A, b, c, u, v,w). □ 

7.3 Non-degeneracy at the maximum 

The following fact will be needed in the sequel: 

Proposition 7.4. The complex roots of \6. 7\ ) with fi ^ are all non- 
degenerate, almost everywhere in A*. 

Proof. Let X = {x, s,y,x, s,y, fi e £im+2n+i . ^ _^ gj ^y e cons i(j er ffo e 
evaluation function 

ev : A* X X -> C 4m+2n+1 

(A,b,c,u,v,w;x,8,y,x,s,y,n) i-> ^^^^(x, s,y,x, s,y, fi) 

where $ was defined in (J6.7J) . 

is a regular value of ev if and only if Dev(A, b, c, . . . , fi) is onto when 
ev(A, b, c, ...,//) = (See |T2l Ch II SI]). 

Lemma 7.5. is a regular value for ev. 

This Lemma guarantees that = ev _1 (0) is a smooth manifold and 
dim V = dim A*. 

Now we consider the natural projection 7i"i : V — > A*. By Sard's theo- 
rem, the regular values of 7i"i have full measure in A*. Since dimV^ = dim A*, 
(A, b, . . . , w) is a regular value if and only if Dili is an isomorphism at ev- 
ery point (A,b, . . . , fi) such that iti(A, b, . . . , fi) = (A, b, . . . , w). For such 
systems, all the roots with fi ^ are non-degenerate. □ 

Proof of Lemma \7.5\ We first reorder the equations and the variables of (|6.7|) 
as follows: 



$(&, c, it, v, w, y, s, y, x, x, s, A, fi) 



Ax — s — b 
A T y - c 

u 1 x + v T s + w T y 

sy — fie 

Ax — s 

sy + sy — e 

A T y 



(7.8) 
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In order to show that -D$ has full rank 4m + 2n + 1, we will show that a 
certain submatrix has rank 4m + 2n + 1. Namely, we will consider only the 
derivatives with respect to variables b to x, and derivation with respect to x, 
s, A and [i will be omitted. We obtain the block matrix 



•T -T -T 

x s y 



A T 



D„ 



w 



A T 



u 



A 



Recall that /j ^ 0, hence no coordinate of s or y can vanish and the 
diagonal matrices D s and D y have full rank. 

Performing row operations on the previous matrix, one obtains: 



• T -T ■ T 

x s y 



A T 



w u 



-I A 
D s D y A 

-A T D-'D y A 



for an invertible lower triangular matrix L. Since not all of Xi, Sj, iji can 
be zero (Lemma 16. 3J) and -D s has full rank, it remains only to check that 
—A T D~ l D y A has also full rank. This follows from the identity: 

-A T D- 1 D y A = n{D~ 1 A) T {D~ 1 A) 

and from the fact that A has full rank. 

Hence, D§ has rank 4m + 2n + 1, and we are done. □ 



7.4 Genericity 

In this section we show that it is sufficient to bound the number of non- 
degenerate roots of systems satisfying conditions 1 through 5 of proposition 

m 

Let K C {1, • • • , m}. We define Sk as the linear space of all {s G C m : 
Sk = o V k e K}. 
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Proposition 7.6. Let m > n. There is a point (A,b,c,u,v,w) G A* such 
that: 

1. The maximal number of non- degenerate complex solutions of \6. 7\ ) 
with /i 7^ is attained at this point. 

2. b^O. 

3. All the solutions at that point are non-degenerate. 

4- For any K C {1, • • • , to}, the linear space Sk and the affine space 
(ker A 11 ) 1 - — b intersect if and only if n — j^K > 0. In that case, the 
intersection has dimension n — j^K. 

5. For any K C {1, - • • ,m}, the linear space S{i r „ >m y\K and the affine 
space {7 : A Tr yc\ intersect if and only ifj^K — n > 0. In that case, the 
intersection has dimension j^K — n. 

Proof. By Lemma l7.3[ item 1 holds on an open set U C A*. Items 2,3 will 
fail only on zero measure set f Proposition 17. 4|) . For items 4 and 5, notice that 
with probability one, dim(ker A ) —b = n and dim{7 : A Tr y = c} = m — n. 
On the other hand, codim Sk^K and codim S , {i i ... jm }\^ = m — #K. Thus it 
is easy to see that systems points violating items 3 and 4 will fail in a finite 
union of zero measure sets. 

Hence, items 2 to 5 will hold on a subset of ^4* of full measure which has 
a non-empty intersection with the open set of Lemma 17.31 □ 

This result has the following consequence: to give a bound for the number 
of non-degenerate solutions of the system ()6.7|) with fi 7^ 0, we can replace 
the initial data by the data (A, b, c, u, v, w) of Proposition 17.61 

Also, for convenience, we will count the number of isolated roots of the 
corresponding system, which is the same. 

7.5 Simplification of the equations 

Lemma 7.7. Set u = u + A T v . The polynomial systems \6. 7| ) and \7.9j) 

below have the same solutions with fi 7^ so that, the isolated solutions of 
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J6'.7| ) with fi 7^ are identical to the isolated solutions of J7.ffi ) wii/i /i 7^ 0. 



# M (x,s,y,x, s,y) 



Ax — s — b 
A T y - c 
sy - /ie 
Ax — s 

//y + y 2 s-y 
u T x + w T y 



0. 



(7.9) 



Proof. This last system is obtained from (J6.7|) by the transformation 

= $ fc , 1 < fe < 5, 

^ 6 = y($ 6 - $3), 
^7 = $7 + -U T $ 4 . 



(7.10) 



When // ^ 0, then no component of y is zero so the solutions of f)6.7j) and 
the solutions of ()7.9|) coincide. □ 

Let gi, ■ ■ ■ , g m - n and / G C m , 7, 0" and w G C m_n be such that 

(a) (gi, • • • , g m -n) is a basis of ker A T , 

(b) A r / = c, 

(c) y = f + T,T=i U lj9j, 

(d) y = Y^7=x n $j9j, 

(e) = w T gj, j = 1 . . . m — n. 

We will denote by gij the i-th coordinate of gj, by G the m x (m — n) matrix 
with entries g^-, by the i— th row of the matrix A, 2 = 1, . . . , m, and by 
A' = (A H A)~ l A H the Moore- Penrose inverse of A (injective); AA^ is the 
orthogonal projection onto im A while A' A = I n . 
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Lemma 7.8. The system \7~Q has the same solutions as 

x - A\s + b) 



tt fl {x,s,y,x,s,y) 



gj(b + s), j = 1 



A T y - c 
sy — fie 
Ax — s 
A T y 

Hy + y 2 s-y 
u T x + w T y 



m — n. 



(7.11) 



Proof. The equations 17.111 -2 are equivalent to b + s G (ker A T ) X that is 
b + s G im A. Under this assumption, x = A^(s + b) gives Ax = b + s. Thus 
17. Ill - 1 and 17. Ill - 2 imply 1220-1 . Conversely, if Ax = b + s we get b + s G im A 
and x = A+(s + 6) that is 177111 - 1 and l7~TTl 2. □ 



7.6 Elimination of variables 

Let us now introduce a new polynomial system with the same number of 
zeros: 

S M (s,x,7,5) = 

Si(fi + YJLxim) - v 



j= i otfij + \Ji + 2^ j=1 jjgijj A iX - \Ji + ; ' ,//,, 
u T x + w T 5 

(7.12) 

where the range for j in 17. 121 -1 is {1, . . . , m — n} and the range for i in 17. 121 - 2 
and l7.12T -3 is {1, ... , m}. We also define the following maps: 



A : C m x C" x C m ~ n x 



xC^C"xC m xC m xCxC m x C m x 



A(s, x, 7, 5, //) = I A\s + b), s, f + 7j9j,i, Ax, ^ 5 j9j, V 

\ 3=1 3=1 

and the projection 

n 24 78 : C n x C m ' n x C n xC m xC m xC n xC m xC-* C m - n x C m xC m xC 



1^2478(^1; z 2, Z3, z Ai Z5, Zq, Z7, Z&) — {Z2, Z4, Z7, Zg) 
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Lemma 7.9. The construction of the system \7.12\j is such that the diagram 



n 



(£j4m+2n+l 

A t 

(Q3m— ra+l 



(Q4m+2n+l 

I n 2478 



zs commutative. Moreover 



1. If(s, x, 7, 5, fi) is a solution of \7.1ty then (x, s, y, x, s, y, fi) is a solution 

of ¥m, 



2. Any solution (x, s, y, x, s, y, fi) of ^7.11\ ) is equal to A(s, x, 7, 5, fx) for a 
unique solution of \7-l 6 4) , 



3. Any isolated solution of J 7. 11]) with /1 / corresponds to an isolated 
solution of \7.12\l with /J 7^ 0. 



Proof. The proof is easy and left to the reader. 



□ 



Now we look at equations 17. 121 -3. 17.121 -4 as a linear system of m + 1 
equations in the m unknowns (5, x), with coefficients depending on 7 and \x. 
When (s, x, 7, 5, /x) is a solution of ()7.12j) with \i 7^ 0, those equations have 
a solution if and only if the determinant of the corresponding augmented 
matrix vanishes. We can write the augmented matrix as: 



M(7,At) 



M5n 



anQi(7) 



ainQi (7) /1 + EJLi™ 7i5ij 



f^9m,m,— 
Wm—n 



Qm{i) 



(ImnQmil) fm 5"] j— 1 1j9mj 



(7.13) 



where $1(7) = ^/i + ^jli™ lj9vj ■ By dividing the first m — n columns by 
/x and then multiplying the last row by /i, we obtain a new matrix M' whose 
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determinant vanishes if and only if the determinant of M vanishes: 



M'( 7 ,/i) 



OllQl(7) 



9 ml 



9m,m—n 
VJm—n 



a m iQm{l) 

fJLUi 



O'mnQmi'y) fm ~i~ 2\Zi'=l ^jdmj 



Its determinant is the same as the determinant of: 



(7.14) 



M"( 7 ,/i) 



511 



9l,m—n 



ainQid) fi 



9 ml 
Wi 



9m,m—n 
VJm—n 



a<mlQm{l) 



u 'mn 

(J,U n 



k 



(7.15) 



We now have to distinguish the three cases of Proposition 16.51 In the 
primal-dual case, we define the eliminating polynomial hpn(j, //) = det M"(7, //). 
In the dual case, we also define /id(7) = det M" (7,^4) but now, since u — 0, 
the eliminating polynomial is independent of fi. In the primal case, w — 
and we notice that the last row of M" is divisible by fi. Hence, we set 
/ ip ( 7 ) = /x- 1 detM"(7,^). 

Lemma 7.10. With the notations above, (s,x, 7, 8, fi) is a solution of \7.1 6 /3j) 

with fi 7^ if and only if 



T(s, x, 7, S, fi) 



5 

M( 7 ,/i) x 
G T (b + s) 

«i(/i + Li=i 7i^)-Si(/i + L J= i 7i0ii, 



(7.16) 
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and \x 7^ 0. 



Proof. The system T = is the same as S = plus the equation h(j, si) = 
which is a consequence of E = as has been explained previously. □ 

Lemma 7.11. The number of isolated solutions of the system fr7.16\ ) with 
fi 7^ is less than or equal to the number of isolated solutions with Si(/i + 
Y!?Iiim) of 



0(a,7) 



G T {b + s) 



(7.17) 



^*(7>*i) 

where the range for i in the second equation is 2 < i < m. 
Proof. This lemma is a consequence of the following facts: 

• An isolated solution (s, x, 7, 8, //) of f)7. 16j) gives an isolated solution 

(s,7) of (EHD, 

• Two distinct solutions (s,x,j,8, fi) and (s', x', 7', 5', //') of (17.161) with 
/i ^ and // 7^ give two distinct solutions (s, 7) and (s', 7') of (|7.17|) 
with si(/i + YJj=ilj9ij) + and s'^/i + EJLT7j#ij) 0. 

The first fact is true because (|7.17|) is a sub-system of (|7.16j) . 

Let us prove the second assertion. Let (s, x, 7, 8, fi) and (s, x', 7, 8', //) 
be two solutions of ()7.16|) with si(/i + Y^=i Ijdij) 7^ 0- O ur a i m * s two 
prove that (x, 8, fi) = (i/, #',//). We have clearly /1 = // 7^ and + 
Ej=i™ 7i^ij) 7^ f° r eacn Moreover (x, 8) is given by the system 



M( 7 ,//) 



5 

i: 



Diag(g,( 7 ))A / + G 7 

W W 




0. 



This system has a unique solution if and only if Rank M(j, fi) = m. Let us 
prove that the m x m submatrix 



( fxG Diag (Qi(i))A ) 
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is nonsingular. Let a G C m n and (3 G C n be given. If 
( fiG Diag (Q;( 7 )M ) ( )5 ) = 

then 

/iGa + Diag (Q;^))^ = 
so that, multiplying by A T , we get 

A T Diag (Qi(7))40 = 0. 

Since (/j + Yl^i lj9ij) 2 > an d Rank A = n the matrix A T Diag (Qi( 7 ))^4 
is positive definite and consequently f3 = 0. Thus /iGa = so that a = 
because fi 7^ and Rank G = m — n. This completes the proof. □ 

7.7 The Bezout bound 

To count the number of isolated roots of this last system we use the multi- 
homogeneous Bezout bound given in Theorem 15.11 For this purpose we 
bi-homogenize the system (j7.17|) : we introduce the homogenizing variables 
So in the first group of variables and 70 in the second group. We obtain the 
system: 



©(s ,s,7o,7) 



G T (s b + s) 



Siiiofi + YJiLxiWi) - «i(to/i + EJLi" 'im) = 

^*Oo,s,7o,7) = . 

(7.18) 

Here h*(so, s, 70, 7) is just the homogeneization of h*(s,j). For instance, 
/iPD is the determinant of the matrix obtained from M"(7, /i) by the following 
changes: 

1. Qi(j) becomes Qi(jo,l) = (lofi + Y^i 

2. fi becomes 70/1 + EJTi™ T^y, 

3. fi in the last column becomes 70 /i, 

4. — ■y i w i in the last column becomes — s E jiWi. 
Lemma 7.12. 



0. 
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1. The system 7.18 is bi-homogeneous in the groups of variables (sq> s) G 
C m+1 and (70,7) e C m - n+1 , 

2. There are m — n equations of multi-degree (1, 0) and m — 1 equations 
of multi- degree (1, 1). The multi-degree of the last equation depends on 
whether * stands for PD, P orD; 

The multi-degree o/Zipd is (l,2n + 1). 

The multi-degree of hp is (0, 2n — 2). 

TTie multi-degree of hp, is (0, 2n + 1). 

(5,7) is an isolated solution of \7.H\j if and only if (l,s, 1,7) is an 
isolated solution of \7.18\f , 

4- The number of isolated solutions of j 7. 1 8\j is bounded as follows: 
When * is equal to PD, by 2n ( m J + 



n I \ n 



Tft — 1 

when * is equal to P, by (2n — 2) I ) ,and 



when * is equal to D, by (2n + 1) 



n 

m — 1 

n 



Proof. The assertions 1 and 2 hold by construction. 

The third assertion comes from a classical fact: when both product spaces 
are equipped with the usual topology, the canonical injection 

i : C m x C m - n -> P m (C) x P m ~ n (C) 

is open and continuous. 

By the Multi-homogeneous Bezout Theorem ( Theorem 15.1(1 . the number 
of isolated solutions in the primal-dual case (* = PD) is no more than the 
coefficient of CiX™ - ™ m the expression 



cr n (Ci + (2) m - L (Ci + (2n + 1) C: 



2) 



In the primal-dual case (item 6), this coefficient is precisely 

(2n + 1) ( m ~ ^\ _|_ ( m ~ 2n ( m ~~ ^\ + ( m 
' \ n ) yn — 1 J y n J yn 

The primal and dual cases are similar. □ 
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7.8 The spurious roots 

Except for the primal case, the number of roots we have obtained is still too 
big to give the bound announced in the Theorem ll.il We have to eliminate 
some of them to obtain the right result. 

There are three classes of bi-homogeneous solutions (s , s, 70, 7) of the 
system (T7~T%1) . 

1. Roots at infinity are roots for which 70 = or s = 0. We will not 

worry about roots at infinity here, 

2. Spurious roots. These are the finite roots for which \i = that is 
si = or 70/1 + lj9lj = 0, 

3. Legitimate roots are all the other solutions. 

Notice that solutions (s, 7, fi) of the system ()7.17|) with S\{fi + Y^=i 7i#ii) 7^ 
correspond always to legitimate roots of ()7.18|) . 

Lemma 7.13. The number of spurious roots of \6. 7]) for * one o/PD or D 




Proof. We will only deal with the primal-dual case, the dual case being ex- 
actly the same. 

The idea of the proof is to produce a bijection from the spurious roots to 
the class of subsets K C {1, • • ■ , m} of cardinality n. 

Since n = s\(fi + Y^=i lj9ij) = 0> spurious roots are the zeros of the 
system 

( G T s = -s G T b, 

I Si (j fi + YlJ=i lj9ij) =0, i = 1, • • • , m, (7.19) 

[ /ipD(7o,7,<so, s) = 

Let (70, 7, s , s) be a spurious root. Since spurious roots are finite we 
assume that 70 = 1 and s = 1. We set K = K(s) — {k 6 {1, • • • , m} : s fc = 
0}. Then, the system f!7.19|) breaks into: 

G T (s + b) = 0, with s e S K 

fi + E7=i n l39ij = a, i*K (7.20) 
^pd(7, s) = 
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The first equation is equivalent to say that s G Sk and s + b G (ker A H ) ± . 
Again, this is the same as saying that s G Sk H ((ker/L^)- 1 — b). 

If the cardinality of K is strictly larger than n, then Proposition l7. 61 itemEl 
guarantees that the intersection of Sk with the affine space (ker A 11 ) 1 - + b is 
empty. Therefore the cardinality of K is at most n. 

The second equation of (J7.2(Jj) is satisfied if and only if the preimage of 
c by A T and Su m \\K have a non-empty intersection. In that case, 73 is 
associated to the z-th non-zero coordinate of a point y at the intersection. 

If the cardinality of K is strictly smaller than n, then the intersection is 
empty because of Proposition 17.61 item 03 

Therefore K has cardinality n. Reciprocally, let K be a cardinality n 
subset of {1, • • • ,m}. Then because of Proposition 17.61 item HI Sk and 
(ker A 11 ) 1 - — b do intersect. Because of item the spaces (A T )~ l (c) and 
S{i,...,m}\K also have a non-empty intersection. 

Therefore, equations f)7.20l — 1. 2) admit a finite common solution (1,7, 1, s). 
Here, it is crucial to use the fact that we are in the primal-dual or dual case, 
and hence ft* is the determinant of M" . It will follow that ft.* (70, 7, sq, s) = 0. 
This happens because for i ^ K, Qi will vanish in (J7.13|) . Also for i ^ K, 
M'(7,/4i,m+i = 0. _^ 

Since \i was replaced by si(/i + Y^ljdij) in the last row of ()7.14|) . the 
matrix M'i^y, /i) has (after reordering) an (m — n + 1) x (n + 1) block of zeros. 
This means that an n + 1-dimensional subspace is mapped into a m + 1 — 
(m — n + 1) = n-dimensional subspace. Hence ft* (7, s) = det M'(j, /i) = 0. 

□ 

Notice that spurious roots must be isolated. Otherwise, there would be a 
component of non- isolated roots of ()6.7|) for fi 7^ 0, and this would contradict 
Proposition 17.61 item 131 Hence, when * is one of PD or D, we can subtract 
the number of spurious roots from the bounds obtained in Lemma 17.121 and 
Proposition ^. 5l follows. Notice that the bound for the dual case is not sharp. 

8 Concluding remarks. 

1. Beling and Verma [3] is a predecessor to our paper. They prove a similar 
result to our Proposition 16.51 but only for subspaces defined by the vanishing 
of one of the coordinates and their estimate is not as strong. 



28 



2. We have estimated the curvature by the number of complex roots of a 
system of equations including possibly roots at infinity. In fact only real and 
finite roots count. The number of real roots is in general much less and can 
in some contexts be compared with the square root of the number of complex 
roots, see Shub and Smale [21], Edelman and Kostlan [TT], McLennan [TT] . 
Rojas [22] and Malajovich and Rojas ^HlCSl- Thus the total curvature at 
least on average may be very small indeed for large problems. We find a 
better understanding of the total curvature of the central path in worst and 
average case analysis an interesting problem. 

3. There is a body of literature on the curvature of the central path, 
relating the curvature to the complexity of Newton type algorithms that 
approximate the central path and produce approximations to the solutions: 
see Sonnevend, Stoer and Zhao [213 1211, Stoer and Zhao |3*T] . Zhao [331 [33]. 
These papers use a different notion of curvature, closer to I/7 where 7 is 
Smale's 7, see also Dedieu and Smale [TU]. The integral of these quantities 
is infinite. 

4. The Riemannian geometry of the central path has been studied by quite 
a few authors, see Karmarkar ^3J, Bayer and Lagarias [21 HUE], Nesterov and 
Todd [2D]. 

5. Vavasis and Ye fSUJ study regions where the tangent vectors to the 
central path stay in definite cones. Curvature estimates may be used as a 
refinement of this information. 

6. Malajovich and Meer ^3] showed that the problem of computing (or 
even approximating up to a fixed constant) the sharpest multi-homogeneous 
Bezout bound for a system of polynomial equations is actually NP-hard. 
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